Illizi Province
Merging Two Cultures: Deep and Statistical Learning
Bhadra, Anindya, Datta, Jyotishka, Polson, Nick, Sokolov, Vadim, Xu, Jianeng
Merging the two cultures of deep and statistical learning provides insights into structured high-dimensional data. Traditional statistical modeling is still a dominant strategy for structured tabular data. Deep learning can be viewed through the lens of generalized linear models (GLMs) with composite link functions. Sufficient dimensionality reduction (SDR) and sparsity performs nonlinear feature engineering. We show that prediction, interpolation and uncertainty quantification can be achieved using probabilistic methods at the output layer of the model. Thus a general framework for machine learning arises that first generates nonlinear features (a.k.a factors) via sparse regularization and stochastic gradient optimisation and second uses a stochastic output layer for predictive uncertainty. Rather than using shallow additive architectures as in many statistical models, deep learning uses layers of semi affine input transformations to provide a predictive rule. Applying these layers of transformations leads to a set of attributes (a.k.a features) to which predictive statistical methods can be applied. Thus we achieve the best of both worlds: scalability and fast predictive rule construction together with uncertainty quantification. Sparse regularisation with un-supervised or supervised learning finds the features. We clarify the duality between shallow and wide models such as PCA, PPR, RRR and deep but skinny architectures such as autoencoders, MLPs, CNN, and LSTM. The connection with data transformations is of practical importance for finding good network architectures. By incorporating probabilistic components at the output level we allow for predictive uncertainty. For interpolation we use deep Gaussian process and ReLU trees for classification. We provide applications to regression, classification and interpolation. Finally, we conclude with directions for future research.
- North America > United States > Illinois > Cook County > Chicago (0.04)
- Europe > United Kingdom > England > Oxfordshire > Oxford (0.04)
- North America > United States > Virginia (0.04)
- (6 more...)
10 Best Python Libraries for Machine Learning in 2021
Python is one of the most popular programming languages on the market and currently takes first place with 33.18% of the market share. And this figure should not be surprising since Python is an extremely easy-to-learn programming language and incredibly flexible at the same time. It is excellent for many purposes, and Machine Learning is one such purpose. Python has many different libraries of complete tools for integrating machine learning technologies into business projects. In this article, we'll take a look at 10 well-known machine learning libraries in Python.
- Banking & Finance (0.85)
- Information Technology > Services (0.49)
Queen's Speech: Government to announce plans for commercial space flights and ports for spaceships
Powers planned by the Government aiming to pave the way for commercial space flights in Britain will be included in the Queen's Speech alongside a raft of investments in transport infrastructure. The legislation, according to Department for Transport (DfT), will allow the launch of satellites from the UK for the first time, horizontal flights to the edge of space for scientific experiments and the establishment of spaceports in regions across Britain. The Queen's Speech, which has been delayed by two days due to the current instability in British politics, will also include measures to improve conditions for the 100,000 drivers of plug-in vehicles by "removing barriers that are preventing more drivers switching to electric". "As things stand, those wanting to use publicly-accessible charging points may need to register with several different companies that run them," the Department for Transport added. "The planned legislation will include measures to ensure drivers need register only once to make full use of the existing infrastructure."
- Europe > United Kingdom (1.00)
- North America > The Bahamas (0.16)
- North America > Panama (0.15)
- (17 more...)